RATIONAL SEMIMODULES OVER THE MAX-PLUS SEMIRING 
AND GEOMETRIC APPROACH OF DISCRETE EVENT 

SYSTEMS 



STEPHANE GAUBERT AND RICARDO KATZ 



Abstract. We introduce rational semimodules over semirings whose addition 
is idempotent, like the max-plus semiring, in order to extend the geometric 
approach of linear control to discrete event systems. We say that a subsemi- 
module of the free semimodule S n over a semiring S is rational if it has a 
generating family that is a rational subset of <S n , <S n being thought of as a 
monoid under the entrywise product. We show that for various semirings of 
max-plus type whose elements are integers, rational semimodules are stable 
under the natural algebraic operations (union, product, direct and inverse im- 
age, intersection, projection, etc). We show that the reachable and observable 
spaces of max-plus linear dynamical systems are rational, and give various 
examples. 
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1. Introduction 



In this paper, we define a new class of semimodules over max-plus type semirings, 
that we call rational semimodules, and study their properties. 

This work is motivated by the max-plus algebraic approach of discrete event sys- 



tems. It is well known (see in particular ]CMQV89| , |BCOQ92[ |Gun9S| , |CCQ99| ]) that 
a subclass of discrete event systems subject to synchronization constraints, com- 
prising examples of manufacturing systems, transportation networks, and computer 
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networks, can be modeled by max-plus linear dynamical systems. An open question 
(see [ GGQ99 ) is to develop the analogue of Wonham's geometric approach []Won85| 
for the control of max-plus linear dynamical systems. As in classical linear system 
theory, many control problems can be phrased in terms of semimodulcs (semi- 
modules over semirings are defined like modules over rings, mutatis mutandis). 
A difficulty of this approach, however, is that max-plus semimodules have very 
different properties from vector spaces. In particular, a subscmimodulc of a free 
finitely generated semimodule need not be free or finitely generated, and so even 
the simplest spaces in control theory, the reachability space and the observability 
"space" or congruence, need not be finitely generated (see the examples in §4.2). 
Therefore, new algebraic tools are needed to "replace" the theory of rank which 
is so useful in classical linear control, and effective methods must be designed to 
handle semimodules with an infinite number of generators. 

Several results are known on max-plus semimod ules, includin g notions of basis 
and extremal poin ts |Mol88| , |Wag9l| , |GP97j |Gau98jl, direct sum s fCGQ96[], projec - 

TJcc 



tive semimodulcs |CGQ97| , separation theorems 1Zim77| , |SS92j , [LMSO0| , |CGQ01 |. 
However, the issue of computing effectively with non finitely generated semimod- 
ules does not seem to have been raised previously in the literature. 

In this paper, we extend the notion of finitely generated semimodule as follows: 
we say that a semimodule X C S n is rational if it has a set of generators that is 
a rational subset of 5", where S n is thought of as a monoid under the entry wise 
product, sec Definition 3.1 below, 
rational sets of (N fe , -\ 
computer science, see 



Rational sets over monoids, and in particular, 
( Z , +) , or semilinear sets, are well known objects in 



GS66, ES69 



The typical semiring to which our notions ap- 
ply is the semiring of max-plus integers, ZU{ — oo}, equipped with max as addition, 
and the usual addition as multiplication: then, up to technical details related to 
the infinite element, rational semimodulcs arc semimodules generated by semilinear 
sets of Z". 

We show that rational semimodulcs are closed under the natural algebraic opera- 
tions, like union, direct sum, direct and inverse image, intersection, projection, and 
by taking the orthogonal. Whereas the closure under union, direct sum, and direct 
image, can be proved in a natural way, our proof of the other properties relies on 
Presburger arithmetics, which leads to expensive algorithms [Opp78|. Finding di- 
rect, computationally more efficient proofs, leads to interesting combinatorial prob- 
lems. In fact, even f or fi nitely generated semimodulcs, algorithmic issues remain 
difficult, see Remark 3Jj below. 

The paper is organized as follows. In §& we recall classical definitions and facts 
about rational sets and idempotcnt semirings, and establish preliminary results. 
We extend the definition of the Presburger logic to a naturally ordered idempo- 
tent sem iring S , and show, as a slight extension of the theorem of Ginzburg and 
Spanier | GS66| , that idempotent semirings like (ZU {— oo},max, +) have the prop- 
erty that the subsets of S n defined by formulas of the first order logic of (S, e, (g>, ;<), 
where e is the unit, ® the product, and H the natural order, are exactly the ra- 
tional subsets of S n . In §|[ we use these results to show that the class of rational 
semimodules is closed under various algebraic operations. In §ji|, we illustrate the 
results by discrete event systems problems, and give various examples and counter 
examples. We show in §4.1 that max-plus reachable spaces and observable congru- 
ences are rational, and then, in §4.2, we give examples of reachable semimodulcs 
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and observable congruences. In §4.3, we illustrate the reachability and observability 
notions by discussing a simple example of manufacturing systems (three machines 
in tandem). In §4.4, we give counter examples showing that the integrity assump- 
tions that we used are useful, and in §4.5, we give a counter example showing that 
the noncommutativc analogues of reachable spaces need not be rational. 



2. Presburger Logic over Idempotent Semirings 

Let us recall some definitions and results. Let (M, •) be a monoid, i.e. a set with 
an associative multiplication and a two sided unit 1m- The class of rational subsets 
of M is the least class S% of subsets of M satisfying the following conditions: 

(1) If U is a finite set then U G 3%\ 

(2) TfU,V€£ then UUV 

(3) If U, V G 0t then U ■ V = {m \ m = u ■ v, u G U, v G V} G 

(4) If U G 3t then U* = U° U U U U 2 U ■ • • G M, 

where by convention U = {1m}- A subset U C M is called semilinear if it can 
be written as a finite union of sets of the form {x} ■ B* , where x G M and B is a 
finite subset of M. We shall use throughout the paper the following classical result 



(sec [ ES69 1 ) : in a commutative monoid, rational and semilinear subsets coincide. 

A semiring is a set S equipped with two internal composition laws ffi and 
ffi, called addition and multiplication respectively, such that S is a commutative 
monoid for addition, S is a monoid for multiplication, multiplication distributes 
over addition, and the neutral element for addition is absorbing for multiplication. 
We will denote by e the neutral clement for addition and by e the neutral clement 
for multiplication. We will sometimes denote by (5,©,®) or (S, ©, ®, e, e) the 
semiring S. In this paper, we are mostly interested in the max-plus semiring K max , 
which is the set R U {— oo} equipped with = max and (£> = +. The semiring 
t max is idempotent: x x = x for all x£«S. An idempotent semiring (5, ©, ©) is 
equipped with the natural order ^, which is defined by: 

x^y<^x®y = y. 



With this order, x © y is the least upper bound of the set {x,y} (see |BCOQ92|). 

Several variants of the max-plus semiring R max can be found in the literature. 
Indeed, to any submonoid (M, +) of (R, +) is associated a semiring with set of 
elements MU{-oo}, and laws ffi = max, <8 = +■ We denote this semiring by A/ max . 
Symmetrically, the semiring M m ; n is the set M U {+00} , equipped with ffi = min 
and ffi = +. For instance, taking M = N, we get N m i n = (N U {+00 }, min, +), a 



semiring known as the tropical semiring after the work of Simon |5im78H (see |Pin98| 



for a recent overview) . The semiring ^ m j n — (^U{©cx)}, min, ©) is sometimes called 



the equatorial semiring [Kro93, Kro94 . One can also add a maximal element (for 
the natural order) to the semirings M max and Af m ; n : this yields the semirings 
M msx = (M U {±cx)}, max, +) and M m \ n = (M U {±00}, min, +). Since the zero 
element is e — —00 in M max and e = +00 in Af m i n , in these semirings, the value of 
(—00) + (+00) = (+00) + (— 00) is determined by the rule e®x = x®e~e. 

It is convenient to formalize the class of semirings to which our results apply, by 
extending the classical definition of Presburger logic, as follows. We refer the reader 



follows |GS66 | 



to [GS66; Bcs02| for more information about Presburger logic. Our presentation 
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Let (<S, ©, 8>, £, e) be an idempotent commutative semiring with natural order ;<. 
We consider formulas or statements about the elements of S. The set P of first- 
order logic formulas of (S, e, ®, ;<) is by definition the smallest class of formulas 
satisfying the following five conditions: 

(1) For any nonnegative integers ki, ri, 1 < i < n, 

n n 

a) (g) '-: • (g) '-; 

i=i i=i 

is a formula in P. Here x^ 1 denotes Xj ® ■ • • <g> Xj, where Xi is repeated 
ki times, and we adopt the convention x° = e. The free variables of this 
formula 

(2) If Pi, P2 are in P, so is their conjunction Pi A P2. The set of free variables 
of Pi A P2 is the set of free variables of Pi union the set of free variables of 

(3) If Pi, P2 arc in V, so is their disjunction P x V P^. The set of free variables 
of Pi V P2 is the set of free variables of Pi union the set of free variables of 

(4) If P is in V, so is its negation -P. The free variables of -P are the free 
variables of P. 

(5) If P(xi, . . . , x n ) is in P and has the free variables Xi, . . . , x„, then for each 
1 < i < n, the formula (3xi)P(xi, . . . , x n ) is in V and its free variables are 
Xj for 1 < j < n and j =/= i. 

In the sequel, we will simply call a formula of V a Presburger formula of (5, e, ®, ;<). 

Remark 2.1. If P(xi, . . . , x n ) is in P, then for each 1 < i < n, the formula 
(Vxi)P(xi, . . . , x n ) is regarded as a first-order logic formula of (5, e, ®, ;<) because 
it is equivalent to 

->(3.t,)(-.P (xi,...,x n )). 

Similarly if P and Q are in P, then P =>• Q is regarded as a first-order logic formula 
of (<S,e,®,^). 

Remark 2.2. The formula x n+ i = @" =1 x^ is regarded as a first-order logic formula 
of (S, e, ®, ^) because it is equivalent to 

(xi r< X„+i) A ... A (x„ ^ x„+i) A 

{(Vx„ +2 ) [((xi ^ x„ +2 ) A ... A (x„ ^ x n+2 )) X„+i ^ x„ +2 ]} . 

For readability, we will allow the use of arbitrary letters (rather than x\, x%, . . .) 
for the variables of formulas, so that we will regard for instance y = 
Presburger formula with free variables Xi, . . . , x n , y. 

We say that a subset D C S n is definable in the first-order logic of (S, e, ®, ;<) 
if there exists a formula P(x±, . . . , x n ) in P, with n free variables xi, . . . , x n , such 
that: 

D = {(xi, ... ,x n ) G S n I P(xi, . . . ,x„) is true } . 

Definition 2.3. An idempotent commutative semiring (S, ©, (£>, e, e) has the Pres- 
burger property if the subsets of 5™ definable in the first-order logic of (5, e, <£>, ;<) 
are precisely the rational sets of {S n , ®). 
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We shall need the following extension of the theorem of Ginzburg and Spanier 
(see [GS66|), which states that the rational subsets of (N n ,+) are precisely the 
subsets definable in the classical Presburger arithmetics. 

Theorem 2.4. The idempotent semirings Z max = (Z U {— oo}, max, +), Z max = 
(Z U {±00}, max, +), N max = (N U {-00}, max, +), N max = (N U {±00}, max, +), 
and N m in = (N U {+00}, min, +) all have the Presburger property. 

The proof of Theorem |]4| relics on the following: 

Lemma 2.5. A subset R C ((Z U {±oo}) n , +) is rational if and only if it can be 
written as a finite union of sets of the form 

(2) {a} + {n,...,f k y , 

where a £ (Z U {±00})" and f 1 , . . . , f k <E Z n . 

Proof. Using the characterization of rational sets as semilincar sets, it suffices to 
show that any set {b} + {r 1 , . . . , r k }*, with b, r 1 , . . . , r k 6 (Z U {±00})™, can be 
rewritten as a finite union of sets of the form (J2J) . Recall the following classical 
rational identities 

(3) (AUB)* = A* +B* 

(4) A* = A I) (A + A*) 

(identity (^) holds for all subsets A, B of a co mmutat ive monoid, whereas (0) holds 
for subsets ^4 of arbitrary monoids, see e.g. [ConTl] for more details on rational 
identities). Using (||) and (||), we can write: 



{b} + {r 1 ,...,r k }* = {b}U |J {b + r*} + {r\...,r k y 

l<i<k 

(5) = {b} U |J ({6 + r*} + {rT + {r j \ 1 < 3 < k, j ± 1}*) 



Ki<k 



Now, for all r £ (Z U {±00})™, denote by f G Z™ the vector obtained by replacing 
infinite coordinates of r by an arbitrary finite value (say 0). One easily gets, using 
the fact that (—00) + x = — 00 for all x £ Z max , and (+00) + x — +00, for all i£Z, 
that 

(6) {b + r} + {r}* = {b + r} + {?}* . 

Using several times the transformations (||), (||), (||), we express {b} + {r 1 , . . . , r k }* 
as a finite union of sets of the form {a} + {f 1 , . . . , f k }*, with 06 (ZU {±00})™. □ 



Proof of Theorem 2-4 ■ By comparison with the result of Ginzburg and Spanier, the 
only new difficulty is to take care of the ±00 elements. Let us consider the case of 
Z max - The other cases can be proved in the same way. 

As a preliminary result, we first check that every element of ZU{±oo} is definable 
by a Presburger formula of (Z U {±00}, 0, +, <). We can regard y = +00 and 
y = —00 as Presburger formulas, since y = +00 (resp. y = —00) is equivalent 
to (\fx)(x < y) (rcsp. (\fx)(x > y)). Similarly, y = 1, which is equivalent to 
~^{y < 0) A (Va;)(-i(x < 0) => y < x), will be seen as a Presburger formula. We note 
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that in Z max , the inequality (jl]) becomes: 

n n 

(7) ^hxi < ^rjXj . 

i=l ] = 1 

Therefore, for any positive integer r, y — r, which is equivalent to (3z)(z = 1) A(y — 
rz), will be seen as a Presburgcr formula, as well as y = — r, which is equivalent 
to {3z)(z = r) A (0 = y + z). Finally, we denote by Nat(y) the Presburger formula 
(y > 0) A -<(y > +co), which expresses the property that y is a natural number. 

We next show that every semilinear set of ((Z U {±00})™,+) is definable by a 
Presburger formula of (ZU {±00}, 0, +, <). Since the family of sets definable in the 



first-order logic of (ZU {±00}, 0, +, <) is closed under union, thanks to Lemma 2.5 
it is enough to show the following: 

(Claim C): For all a G (ZU{±oo})™, andf 1 , . . . , f k G Z", the set (§) is definable 
by a formula of the first-order logic of (Z U {±00}, 0, +, <). 

Indeed, for each 1 < i < n let us define the set Ji = {1 < j < k | r\ < 0}. Then, 
the vector (xi, . . . , x n ) G (Z U {±oo}) n belongs to {a} + {f 1 , . . . , f k }* if and only if 

(3 yi ),..., (3y fe ) (Nat ( yi ) A • ■ ■ A Nat(y fc ) A /\ P^Xi, yx, . . . , y h )) , 

l<i<n 

where: 

(8) Pi(xi,yi, ...,y k ) = (3zi)((zi = a t ) A (x t + ; r' ;//, = m + ^ HV]))- 

Since (^) is a Presburger formula of (Z U {±00}, 0, +, <), so docs (0), so Claim 
C is proved. Therefore, every rational set of ((Z U {±00})",+) is definable by a 
Presburger formula of (Z U {±00}, 0, +, <). 

Let us now show that every subset of (Z U {±00})™ definable by a Presburger 
formula of (Z U {±00}, 0, +, <) is a rational set of the commutative monoid ((Z U 
{±oo})™, +). As the family of rational sets of ((Z U { ±00}) ", +) is closed with re- 
spect to union, intersection and complementation (see |ES69 |) and as the projection 



of a rational set of ((Z U {±00})™, +) is a rational set, it is enough to show that for 
all nonnegativc integers, r,^ k iy 1 <i<n, the set S of solutions of 

n n 

(9) ^ /.-,.'■, - X! 

i=i j=i 

is a rational set of ((Z U {±00})™,+). To see this, consider the map k : Z U 
{±00} — > {0, ±00}, which fixes —00 and +00, and sends any finite number to 0. 
We extend k to a map (Z U {±00})" — > {0, ±00}™ by making k act on each entry. 
We shall call k(x) the pattern of a; G (Z U {±oo})". To show that S is rational, it 
is enough to prove that for every p G {0, ±00}™, the set of solutions with pattern 
p, S p = S D (p) , is rational. Let I(p) = {1 < i < n \ pi = ±00}, and let J(p) 
denote the complement of I(p) in {1, . . . , n}. When x has pattern p, (|9|) can be 
rewritten as 

(10) a+ kiXi <b+ rj-Xj , 

where a = kiPi and 6 = Ejeifp) r jPj- Note that a and & can take values 

only in {0, ±cx)} (a = if fej = for all i G ^(p), and 6 = if r } ■ = for all j G I(p), 
due to the convention x Xi = which is implied by the convention = e that we 
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made when writing (0)). Note also that an empty sum is equal to 0, by convention. 
Only the following cases can occur. 

Case 1. a = — oo. Then, ( |lu| ) is automatically satisfied, and we conclude that 
S p = = {x G (Z U {±oo})™ | Xi = pi for i G I(p) and x t G Z for i G 

J(p)}. The set 5 P , which is a Cartesian product of rational sets of commutative 
monoids, is rational. (Indeed, S p is the Cartesian product of one element subsets of 
(Z U {±oo}, +), which are obviously rational, and of copies of Z = { — 1, 1}* which 
is a rational subset of the monoid (Z U {±oo}, +).) 

Case 2. a ^ — oo. We split this case into subcases: 

Case 2.1. a ^ — oo and 6 = — oo. Then, S p = 0. 

Case 2.2. a ^ — oo and 6 = +oo. Then, S p = and we proved in Case 1 that 

S p is rational. 

Case 2.3. a ^ — oo and 6 = 0. We again split this subcase. 
Case 2.3.1. a = +oo and 6 = 0. Then, S p = 0. 

Case 2.3.2. a = and b = 0. Then, S p = {x G (Z U {±oo}) n | x t = p t for i £ 
I(p), Xi G Z fo r i G J(p), and Y,i£j( P )hxi < J2je.j( P ) r j x j}- % tne classical 
result of [GS66], the set of finite integer solutions of an equation of the form ([?]) 
is rational, therefore, T = {x G Z J ( p ) | ^i^i — Sjej( p ) r i x i} i s a rational 

subset of Z j (p). Since is the Cartesian product of T by one element sets, S p is 
rational. 

Thus, the set S = U p e{o ±oo}" °^ solutions of ([)]) is a rational set of ((Z U 

{±00})",+). □ 



Example 2.6. The idempotent semirings M ma x and Q max = (QU {— oo},max, +) 
do not have the Presburger property. As a first counter example, consider the 
set D\ — {x G S | x > 0}, where S = M ma x or Q max - This set is defined by a 
Presburger formula, but is not rational. Indeed, it follows from the representation of 
rational sets as semilincar sets that the set of non-zero elements of any rational set 
contained in D\ has a minimal element, whereas D\ does not have this property. To 
give a second counter example, note that any set definable by a Presburger formula 
of (R U {— oo}, 0, +, <) or (Q U {— oo}, 0, +, <) must be stable by multiplication by 
a positive constant. Therefore, the rational set D2 = {1} cannot be defined by a 
Presburger formula. Another example of idempotent semiring which does not have 
the Presburger property is S = ((ZU {— oo}) 2 , max, +), where max denotes the law 
(Z U {-oo}) 2 x (Z U {-oo}) 2 — > (Z U {-oo}) 2 which does entrywise max. In this 
semiring the set {(1, 0)} cannot be defined by a Presburger formula (for symmetry 
reasons, there is no way to distinguish (1, 0) from (0, 1) using Presburger formulas). 



3. Closure Properties of Rational Semimodules 

Let us recall some definitions. A (left) semimodule over a semiring (S, ©, ®, £5, e) 
is a commutative monoid (X, 0, Ex), equipped with a map S x X — > X , (A, x) — ► \x 
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(left action), that satisfies 

(11a) (A ® n)x = X(fix) , 

(lib) X(x © y) = Ax © Ay, (A © = Ax ffi ^ix , 

(11c) £5X = £at, Ae* = eat, ex = a; , 

for all x,y £ X, A, fj, € 5. In the sequel, we will denote by e both the zero element £5 
of S and the zero element ex of X, when there will be no risk of confusion. We will 



also use concatenation to denote the product of S, so that (|lla| ) will be rewritten as 



(Xfi)x = X(/j,x). When (5, ffi) is idempotent, (X, ffi) is idempotcnt (indeed, it follows 



from ( |llb| ) and (11c) that x = ex = (e © e)x — ex © ex = x © x). A subsemimodule 
of X is a subset Z C X such that Ax ffi fiy £ Z, for all x,y £ Z and A, /i £ 5. 
We will consider subsemimodules of the /ree semimodule 5", which is the set of 
77,-dimensional vectors over <S, equipped with the internal law (x © y)i = Xi ffi 
and the left action (Xx)i = X ffi Xj. If G c 5™, wc will denote by spanG the 
subsemimodule of 5 n generated by G, i.e. the set of all x £ S n for which there 
exists a finite number of elements it 1 , . . . ,u k of G and a finite number of scalars 
Ai, . . . , At £ S, such that x = A^u 8 . 

Definition 3.1 (Rational semimodules). A subsemimodule X C <S™ is rational if 
it has a generating family which is a rational subset of the monoid (5", ffi). 

We now show that rational semimodules are closed under natural algebraic op- 
erations. We begin by a simple general property. 

Theorem 3.2. Let S be an arbitrary semiring. Let X, y C S n and Z C S p be 
rational semimodules. Then X ffi y and X x Z are rational semimodules. 

Proof. Let X = spanB, y = spanG and Z — span!?, where B,C C S n and 
D C S p arc rational sets. As X ffi y = span (BUG), it follows that X ffi y is a 
rational semimodule because B U G is a rational set of the monoid (5", g>). Let 
us denote by Sk, for k £ N, the neutral element for addition in the commutative 
monoid (S k , ffi) and let us define the sets 

* = {{s p ) lXeB } aUd£)= {{ £ z) lZeD 

Since B and D are rational sets, B and D are rational sets of the monoid (S n+P , g>). 
Then, as A? x J? = span (BUD), it follows that X x is a rational semimodule. □ 

Wc will need the following analogue of Caratheodory theorem, which was already 



stated in |Gau98|. (The classical Caratheodory theorem, see e.g. |Sch88, Cor. 7.1i], 
states that if a vector x in 1" is a positive linear combination of vectors of a finite 
subset G C K™, x can be written as a positive linear combinations of at most n 
vectors of G). 

Proposition 3.3 (Max-Plus Caratheodory Theorem). Let S be an idempotent 
semiring whose natural order is a total order. Lf G C S n , and if x £span(G), then 
there is a subset B of G, of cardinality at most n, such that x £span(_B). 

Proof. If x £ spanG, we can find u 1 , . . . , u k £ G, Ai, . . . , A& £ S such that x = 
®i<i<kXiU l . For all 1 < j < n, we define I (J) = {i \ 1 < i < k, Xj = XiUj}. Since 
the natural order of S is a total order, all the L(j) are non-empty. Choosing exactly 
one element ij in we obtain a family u 11 , . . . ,u ln such that x = X^u 11 ffi • ■ ■ ffi 
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\i n u ln (It may be the case that ij = ik for some j ^ k. In such cases the cardinality 
of B is less than n.) □ 

Theorem 3.4. Let S be an idempotent commutative semiring which satisfies the 
Presburger property and whose natural order is a total order. Then, for a subset X 
of S n the following statements are equivalent. 

(1) X is a rational semimodule. 

(2) X is a semimodule and a rational subset of the monoid (iS n ,(g)). 

Proof. Trivially, (||) implies (|l|) because X is generated by X. Suppose now that X 
is a rational semimodule and let G £ S n be a rational set such that X = spanG. 
Let P be a formula of the first-order logic of (5, e, ®, that defines G. The 
Max-Plus Carathcodory Theorem implies that: x £ X if and only if 

(Bu 1 £ <S"), . . . , (3u n £ S n ), (3Ai £ S), ... , (3A„ £ S), 

n 

(Piu 1 ) A • ■ • A P{u n ) A x = A,w 4 

i=l 

Since the last formula belongs to the first-order logic of (S. e, %. <), we obtain that 
A" is a rational set of the commutative monoid (S n , <8>) □ 

If X and y are two semimodules over S, we denote by Hom(X, y) the set of 
linear maps, i.e., of semimodule morphisms, from X to y. A linear map S n — > 5 P 
can be represented uniquely in matrix form, x i— > Aa;, = ©i<j< n -^ij^j, 

where A = {A tJ ) eS pxn . 

Theorem 3.5 (Closure theorem). Let S be an idempotent commutative semiring 
which satisfies the Presburger property and whose natural order is a total order. Let 
X, y £ S n , Z £ S p , g C S n+P and W £ (S n ) 2 be rational semimodules, and let 
A £ Hom(iS™,iS p ). Then the following sets all are rational semimodules. 

(1) xny, 

(2) Xg = {v £ S p | 3x £ X, (x, v) £ g} and gZ = {u £ 5™ | 3z £ Z, (u, z) £ 

Q}, 

(3) AX = {Ax | xe X}, 

(4) A~ X Z = {x £ 5' 1 | Ax £ Z}, 

(5) Xoy = {ue S n | 3y £ y, u y £ A}, 

(6) W 1 - = {x £ S n | a • x = b ■ x, V(a, b) £ W} } w/iere a-x = (& 1<i<n a%Xi, 

(7) A" T = {(a, 6) £ (5™) 2 | a ■ x = b ■ x, Vx £ X}. 

Proof. 0. Since A" and 3^ are rational semimodules, we know that they are rational 
sets (by Theorem 3.4). As the intersection of rational sets of a commutative monoid 
is a rational set (sec [ES69Q, we have that X D y is a rational set and therefore a 
rational semimodule. 

H By symmetry, we only consider the case of Xg. Since g C S n+P and X £ S n 
are rational semimodules, we kno w th at they are rational sets of (<S™ +P ,<g>) and 
(5",®) respectively (by Theorem 3A). Let P and Q be Presburger formulas of 
(S, e, ®, <), defining g and X respectively. Then as 

v £ Xg if and only if (3a; £ S n ){Q{x) A P{x,v)), 

it follows that Xg, which is defined by a Presburger formula of {S ,e,®,<), is a 
rational set. By Theorem 3.4, it is a rational semimodule. 
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[| Let us define Q = {(u,Au) \ u € S n }. Since £ is finitely generated, Q is a 
rational semimodule, and AX = XQ is a rational semimodule. 

§ Taking again £/ = {(u,Au) \ u G 5"}, we have A 1 Z = QZ. Hence, A 1 Z is 
a rational semimodule. 

[| Let us define Q = {(u,y,x) G (S n ) 3 x = u © y}. Then 5, which is the 
direct image of {S n ) 2 by a linear map, is finitely generated, and a fortiori, rational. 
Thus, X © y = {u G S n | 3a; G X, By G y, x = u © y} = {u G 5" | 3a; G A", By G 

(u, j/,i)e5} = 5(Jx X) is a rational semimodule. 

is a rational semimodule, we know (by Theorem |3.4| ) that it is 
a rational set. Let P(ui, . 
defining W. Then (xi, . . 

Vui G S, . . 



. . , u n , vi, . . . , u n ) be a Presburgcr formula of (S, e, ©, :<) 
, i„ ) G VV if and only if 



, Vm„ G S, Vui G <S, 

. . ,Un,Vi, . . . , V n ) ■ 



. , Vw„ G S 

n n 

Xim = XjVj). 

1=1 .7=1 



Since this is a Presburgcr formula of (S, e, ®, ^), it follows that W is a rational 
set of (5™, ©), and also, by Theorem ^4, a rational semimodule. 

0. Let P(xi, . . . , a;„) be a Presburgcr formula of (<S, e, <g>, ;<) defining Af. Then 
we have that (u, v) G X T if and only if 

n n 

(Vxi G S), . . . , (Vx„ G 5), (P(x!,. ..,x n )=> (Qu l x l = @ViXi) . 

»=i j=i 

Arguing as in Statement ||, we conclude that A" T is a rational semimodule. □ 

Remark 3.6. A motivation for con sidering the operations and Z — ► A~ l Z comes 
from invariant spaces (see | Won85|). If one consider the dynamical system 



x(k) = Ax(k - 1) © Bu(k), 

where A G (Z max )" x ", B G (Z max )» x P, G (Z max )'\ andu(fc) G (Z ma *) p , the set 
of x(0) for which there exists a control u(l) such that a;(l) belongs to a prescribed 
semimodule X is A _1 (X © £>), where S denotes the semimodule generated by the 
columns of B. Max-plus (A, £?)-invariant spaces are further studied in [Kat]. 



Wc shall say that a vector v of a semimodule X C S n is extremal if u ^ span (A" \ 
span {?;})■ We denote by Ext(<Y) the set of extremal points of X. The interest in 
extremal points stems from a theorem due to Moller |Mol88] and Wagneur Wag91|, 
which states that a finitely generated subsemimodule of (R max )™ is generated by 
its extremal vectors. 

Theorem 3.7. Let S be an idempotent commutative semiring which satisfies the 
Presburger property and whose natural order is a total order. If X C 5™ is a 
rational semimodule, then Ext(#) is a rational set of the monoid (S n ,®). 

Proof. Let P be a Presburger formula of (S, e, ©, ;<) defining X. The max-plus 
Caratheodory theorem shows that v G span (X \ span{«}) is equivalent to 

(3m 1 g S n ), . . . , (Bu n G 5"), (3A X G 5), . . . , (3A„ G S)^ 1 ) A • • • A P(u n ) 



A (v = X lU l ) A - ((3ai G S)^ 1 = ai v) V ■ ■ • V (Ba n G 5)(ti 7 ' 



i=l 
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Since this is a Presburger formula of (<S, e, <8>, ;<), it follows that X \ Ext (A 7 ) is a 
rational set, and therefore Ext (A 7 ) is a rational set. □ 



Remark 3.8. We could prove Statement [| of Theorem 3J) without using Prcs- 
burger's arithmetics, as follows. If R is a rational set that generates the semimodule 
X, AX is generated by the set A{R) = {Ar \ r G R}. One can show directly, using 
the fact that a max-plus linear map is piccewise affine with integer slopes, that 
A(R) is rational. 

Remark 3.9. A difficulty, in looking for more direct proofs of Statements [j],|]|4] [i] of 
Theorem 3.5, is the relative absence of knowledge of the minimal set of generators 
of a semimodule defined by natural algebraic operations. This difficulty persists 
even in the case of finitely generated semimodulcs. For instance, the only known 
algorithm (see pH84] , ]Gau92| , 111,1.1.4] or JGP97| , Th. 8]) to compute a generating 
family of the set of solutions of the max-plus linear system Ax = Bx, where A, B 
are nxp matrices, has an a priori doubly exponential execution time, and tells little 
about the geometry of extremal points. (However, the doubly exponential bound 
is pessimistic, the average case is better in practice, and finding only one solution 
can be done more efficiently by computing sub-fixed point of min-max functions, 
see [|WB96|, |GP97| pCG99[ and pG98|, pTGG99[ for fixed point algorithms for 



min-max functions.) 



4. Examples and Counter Examples 

4.1. Reachable and Observable Spaces of Max-Plus Linear Discrete Event 
Systems. Let us consider the max-plus linear system: 

(12a) x(k) = Ax(k - 1) © Bu(k), 

(12b) y(k) = Cx(k), 

(12c) x{0) = £ . 

where A G (Z max )" x ™, B G (Z max )" x ?>, C G (Z max )? x ™, £ € (Z max )«, and u(k) g 
(Zmax) 1 ', fc = 1,2, . .. is a sequence of control vectors. We call reachable space in 
time k, and denote by TZk, the set of states x(k) reachable from the initial state 
a;(0) = e. We also define the reachable space in arbitrary time, TZ^, which is the 
union of the TZk- (We shall sometimes write TZk(A,B) or TZ^(A,B) to emphasize 
the dependence in A, B.) Introducing the reachability matrices 

R k = (B, AB,..., A k ~ 1 B), R w = (B, AB, A 2 B . . .) , 

we characterize TZk (resp. TZJ) as the semimodule generated by the columns of the 
matrix (resp. R u ). Identifying matrices with operators, we will write TZk = 
Im Rfc, and 1Z W = Im R u . 

The definition of rational semimodulcs is motivated by the following result: 



Theorem 4.1. Reachable spaces are rational semimodules, i.e. if A S (Z m; «) 
and B G (Z max )™ xp . then TZ^ = ImR u is a rational semimodule. 



n x 



The proof of Theorem 4.1 relics on the following cyclicity theorem for reducible 
max-plus matrices, which is taken from [Gau92, VI, 1.1. 10]. 



12 



STEPHANE GAUBERT AND RICARDO KATZ 



Theorem 4.2. Let A G (IR max )" xn . There are positive integers c,N, such that for 
all 1 < i,j < n, f/iere are scalars Xq, . . . , A c _i (depending on i,j) such that for all 
< Z < c- 1. 



Aj(4 nef, )< 



(13) Vn>iV, (A" ;i j-/nv« w 

This cyclicity theorem follows readily from the characterization of max-plus ra- 
tional series in one variable as merge of ultimately rational series, see [Mol88|, 
jGaugg , VI,1.1.8], pCR9l , and the discussions in ]Gau94j , |GP97| ], 



Proof of Theorem Theorem 4.2 implies that {A , A 1 , A 2 , . . .} is a rational sub- 
set of ((Z U {-oo})" xn , +), and therefore, * = span {A , A 1 , A 2 , . . .} is a rational 
subscmimodule of (Z max ) nx ™. Since TZ k3 (A, B) is the sum of the reachability spaces 
TL^A, B.^i) associated to the differents columns B. i of B, for 1 < i < p, and since 
the sum of rational semimodules is rational (cf. Theorem 3.2), it is enough to con- 
sider the case when B has only one column. Then, TZ U is the direct image of X by 
the linear map (Z max ) nx ™ — > (Z max ) nxl , X ^ XB, and it follows from Statement^ 
of Theorem 3^3 that 1Z U is rational. □ 

Let G (Z max ) n , and consider two trajectories of the dynamical system (|l2|), 

{(x(fc),y(fc))} fc >o, and {(x'(k), y'(k))} k >o , 

corresponding to the initial conditions ir (0) = £, x'(Q) = the zero control u(k) = e 
being applied in both cases. We call observable congruence in time k > 1, and 
denote by Ok, the congruence over (Z max ) n defined by 



2/(0 = j/'G), VO < Z < fc - 1 , 



and the observable congruence (in arbitrary time) O u is defined as the intersection 
of the congruences Ok, k > 1. By congruence, we mean an equivalence relation on 
(Z max ) n compatible with the semimodulc structure of (Z max )™. In particular, Ok 



and O w are subsemimodules of ((Z n 



\ Introducing the observability matrices 



( C \ 

CA 



Ok 



we characterize Ok (resp. 
(resp. Ou>), that is: 



0_ 



( C \ 

CA 
CA 2 

V '■ J 



\CA k - 1 J 

O u ) as the right kernel KerOfc (resp. KerO w ) of Ofc 



Sec JCGQ99| for more background on max-plus reachability spaces and observable 



congruences. We have the following dual version of Theorem 



4.1 



Theorem 4.3. Observable congruences are rational, i.e. if A G (Z max ) nx ™, C G 
(Z max ) 9Xrl , then Ou, = KcrO w is a rational subsemimodule o/ ((Z max )™) 2 . 



Proof. By Theorem 4.1, the semimodulc Z generated by the rows of the observ- 
ability matrix O w , which can be identified to the reachable space TZu,(A T ,C T ), is 



rational. Since O u 
nal. 



Z , Statement [7| of Theorem 3.5 shows that O u is ratio- 

□ 
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Figure 1. Exponential representation of the reachable spaces 
^3,^4,^5,^6 for the (A, B) pair given by @ 



4.2. Example of reachable space and observable congruence. Consider 

/ 1 -oo -oo\ / 

(14) A = I 5 2 -oo , B=\-oo 

oo 6 3 J \ — OO y 

Then IZ^ = Im where 

/ 1 2 3 4 5 6 

(15) R w = -oo 5 7 9 11 13 15 

\-oo -oo 11 14 17 20 23 

Obviously IZ^ is a rational scmimodule because the set of columns of R w can be 
written as U U ({v} 

2 



fW), 


with 










-oo), 






— oo / 







(16) U = 

The semimodules IZ3 , 7?.4 , 7?-5 , 7?-6 are shown on Figure |]. 

To represent semimodules which contain vectors with —00 coordinates, we use 
the following projection. Let (3 denote a positive parameter, and let us chose 
a triangle in the plane. We represent a point x £ (R U {— oo}) 3 by the point 
tt(x) of the triangle, which is the barycenter of the vertices of the triangle with 
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respective weights exp(/3xi), exp(/3x2), exp(/3x3). We shall refer to this projection 
as the exponential projection in the sequel. The exponential projection has the 
property that if two points x and y are proportional in the max-plus sense, that is, 
if Xi = X + Hi for some A € M, then, n(x) = 7r(y). Therefore, representing the image 
of a scmimodulc X C (K m ax) 3 (or ,Y C (Z max ) 3 ) by 7r gives a faithful image of 
X, Such drawings represent in fact the max-plus two-dimensional projective space, 
which is the quotient of (R m ax) 3 by the parallelism relation x ~ y x = A + y 

for some A 6 1. The max-plus projective space appeared in the work of several 
authors, see ]Kol92| , pau95| , |Mai95| , |Gau98| , 

In Figure |1|, the generators of the semimodules 7^.3, 7£.4, 7?-5, 7\Lg, that is, the 
columns of the matrices R3,R4,R5,Rg, are represented by bold points. For any 
two generators, we have represented the max-plus plane generated by these two 
generators (we call plane a semimodule generated by two nonproportional vectors). 
The projection tt sends in general a plane to a broken segment. For instance, the 
bold broken segment on the fourth picture of Figure [l] represents the max-plus 
plane generated by the second and fifth columns of Rg. 

It should be graphically clear from Figure |l| that the generators are extremal, 
that the semimodules IZk, k = 0, 1, 2, 3, . . . form an infinite ascending sequence (this 
illustrates the fact that the semimodule (Z max ) 3 is not Noetherian), and that TZ U is 
not finitely generated. One can check mechanically all these facts by appealing to 
residuation theory, which allows us to compute the extremal vectors of semimodules, 
sec [BCOQ92|,[But94 and [GP97] for more details. Let us also mention that the 



computations of this example have been checked using the max-plus toolbox of 
scilab, see [ Plu98|| . 

We can visualize, on the drawings of Figure [l], both the R max semimodule and 
the Z max semimodule generated by the columns of the matrices Rfc. The gray zone 
represent an K max semimodule. The corresponding Z max scmimodulc is an "integer 
lattice" inscribed in the real semimodule, that for readability of the figure, we do 
not have represented. 

To see graphically that the semimodule TZ U is rational, it is convenient to use 
another representation, in which every finite point of 1Z U is projected orthogonally 
to the main diagonal of R 3 : again, two vectors x,y £ R 3 which are proportional 
in the max-plus sense, are sent to the same point. Using this projection, the 
semimodule H12 is represented on Figure |^. The rationality of IZ^ can be visualized 
on this figure: the set of finite generators of 1Z U , which is given by + where 
v, w are as in (|l6|), is precisely the discrete half line of bold points. 

Let us now represent an observability congruence. We consider the transposed 
dynamical system with new observation matrix C = B T and new dynamics A T . 
Then, the observability matrix is O UJ (A T , B T ) = (R w (^4, B)) T , that is, the transpose 
of the matrix computed in (|l5|). The correspon ding obs ervable congruence O u 



is depicted in Figure [| using the technique of [ |CGQ99 , § 4.3]: (We only give 



the orthogonal projection here, an exponential projection of another congruence 
will be given later on, in Figure ||.) We know by Theorem 13 that this is a 
rational congruence. The gray region of Figure [| represents the semimodule over 
the min-plus semiring Z m j n = (Z U {+00}, min, +) generated by the opposite of 
the rows of O w (the min-plus generators are represented by bold points): we can 
derive from [ CGQ99| that equivalence classes for of points of the interior of 
this semimodule are singletons. Let us check this elementarily for the point £ = 
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Figure 3. Orthogonal projection of the observable congruence as- 
sociated to {A T , B T ) 



(0,0, 0) T (indicated by one of the two circles on the figure). We have: = 
(0, 5, 11, 14, 17, . . .) T . If O w £ = O^C , from (O w £')i = (O w £)i = it follows that 
d = 0. Then (CU')2 - max(£ + 1,$ + 5) = (O„0a = 5 implies that £, = 0. 
Finally, from (O u £') 3 = max(££ +2, &+7, ^+11) = (O w £) 3 = H it follows that = 
0. Therefore O w £ = O w £' =>• £' = £ = (0, 0, 0) T . Other equivalence classes are half- 
lines, as shown on the figure. As an example let us compute the equivalence class of 
the point £ = (—2, —7, — 11) T (also indicated by a circle on the figure). We have that 
O w £ = (-2, -1, 0, 3, 6, . . .) T . If O w £ = O w £', from (O u ?)i = (CU)i = -2 it follows 
that £ = -2. Then (0^') 2 = max(££ + 1,^ + 5) = (O w £) 2 = -1 implies that 
^ < -6 and (O w f') 3 = max(f£+2,&+7 ) &+ll) = (O^a = implies that $ < -7 
and £ 3 < -11. Finally, from (O^f ) 4 = max(^ + 3, + 9, £ 3 + 14) = (O w £)4 = 3 it 
follows that £3 = —11. Now a straightforward computation shows that any point 
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Figure 4. A timed event graph representing three machines in tandem 



£' of the form (— 2, a, — 11) T , where a < —7, satisfies = O^'. Therefore the 
equivalence class of £ = (-2, -7, -11) T is {(-2, a, -11) T | a < -7}. 

4.3. Manufacturing system interpretation. We next interpret the previous 
computations in terms of discrete event systems. The dynamical system (|l2),(|l4[) 
can be seen as the dater representation of the timed event graph of Figure 4 (we 



refer the reader to [BCOQ92| for more details on the modeling of timed event 
graphs). 

This graph represents three machines in tandem, with respective processing times 
1,2,3. The first machine is fed by a source it, and sends its output to a second 
machine, with a transportation delay of 5. The second machine sends its output to 
a third machine, with a transportation delay of 6. We associate to each transition a 
dater function N — > K max : for instance, u(k) gives the date of the fc-th firing of the 
transition labeled u, i.e. u(k) is the arrival time of the fc-th part, x$(k) gives the 
date at which the third machine initiates its fc-th task, etc. The output transition 
labeled y represents the times at which finished parts become available. The tokens 
in the places x\ — ► X2 and X2 — > £3 represent unfinished parts, which are initially 
available when the activity starts. The reachable spaces IZk, which were depicted 
in Figure ||, determine the possible values of the daters Xi(k), i = 1, ... ,3. The 
assumption that x(0) = e means that the machines are ready to operate much 
before the first part arrives from the source, so that only the u 1— > x relation is 
considered. 

Practically relevant quantities are the differences Xi — xf for instance, x^Qc) — 
Xi(k— 1) gives the sojourn time of the (fc — l)-th part in the storage resource between 
the first and the second machine. The timed event graph of Figure Q is an example 
of instable system, since the second machine is slower than the first machine, parts 
may accumulate infinitely in the intermediate storage resource. This is reflected by 
the unboundedncss of the orthogonal representation of the reachable semimodule, 
in Figure ||. For instance, one can obtain for the trajectory x(k) the sequence of 
columns of the matrix 1Z U by taking u(k) = k — 1. 

The finite control sequence which leads a;(0) = e to x(k) — z can be computed 
by solving the system Rfct/fc = z, where Uk = (u(k), . . . ,u(l)) T . This system can 



be solved in polynomial time using residuation theory, see lBCOQ92fl (or ]But94| 



for a more combinatorial presentation). We did not address the difficulty that 
the finite control sequence Uk which leads to a given point of the reachable space 
need not be physically admissible, because dater functions must be nondecreasing. 
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Nondccreasing controls can be modeled at the price of adding one variable: if u 
is an arbitrary control sequence, the max-plus linear dynamical system v{k) = 
v{k — 1) © u{k) computes the nondccreasing hull v of u, and therefore v represents 
an arbitrary nondecreasing control sequence. 

Let us now interpret the observable congruence in terms of discrete event 
systems. Consider two trajectories {(x(k),y(k))}k>o and {(x'(k), y'(k))}k>o asso- 
ciated to the same input sequence {u( k) }k>i- We can write 

(17) j/O) = CA k x(0) © CA* _1 Su(l) © • • • © CBu(k) . 

Comparing (Jl7|) with the similar formula for y'(k) we get that the following three 
assertions are equivalent: 

(1) the outputs y and y' corresponding to the zero input sequence satisfy 
y(m) = y'(m) for all < m < k, 

(2) for all input sequences, the associated outputs satisfy y(m) = y'(m) for all 
< m < k, 

(3) (x(0),x'(0))GO k . 

In a ring, since addition is canccllative, the above assertions are equivalent to the 
following one: 

(4) the associated outputs y and y' corresponding to some input sequence u 
satisfy y(m) = y'(m) for all < m < k. 

The implication ||=>|| is no longer true for linear systems over K ma x- In the sequel, 
we shall say that two initial conditions x(Q) and x'(0) cannot be distinguished by 
observation up to time k G NU{w} if any of the properties [l] |^ holds. When k = u, 
we will simply say that x(0) and x'(0) cannot be distinguished by observation. 

The congruence O w obtained for the transposed dynamics A T and observation 
matrix B T , already depicted in Figure corresponds to a timed event graph in 
which the arcs are reversed, by comparison with the timed event graph of Figure || 

To give another example, with a more interesting physical interpretation, let 
us introduce the observation matrix C = (— oo, — oo,3), which corresponds to the 
output y = 3.T3 visible on Figure |], and consider the observable congruence W 
corresponding to the pair (A,C), namely, O u = KerO^, where 



<X = 



( — 00 


—00 




—00 


9 


6 


14 


12 


9 


17 


15 


12 


20 


18 


15 



V 



We have depicted in Figure || the observable congruence associated to (A, C), 
which is not only rational, but also finitely generated (as a semimodule) . The figure 
represents four different types of equivalence classes associated to finite points: for 
example the equivalence class of any point of the form (2:3 — 5,x 3 — 3,x 3 ) T is 
{(xi, X2, X3) 71 I x\ < X3 — 5, X2 < X3 — 3}, which is represented by the darkest 
tetragonal region, labeled (I), in Figure ||. The light gray triangle in Figure [| 
which is labeled (II), represents the set of finite points of the semimodule over 
the min-plus semiring Z m j n generated by the opposite of the rows of O w : we use 



again the argument of |CGQ99| showing that equivalence classes for O u of points 
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(I) : starting time of machine 3 is critical 

(II) : the starting times of all machines are critical 

(III) : the starting times of machines 2 and 3 are critical 

(IV) : the starting times of machines 1 and 3 are critical 



Figure 5. Exponential projection of the observable congruence 
associated to the timed event graph of Figure f|. 



in the interior of this set are singletons. Other equivalence classes are either half- 
lines, as shown on the figure, or the singleton {(— oo, — oo, — oo)}, which cannot be 
represented by this projection. Observation means looking at output times of parts. 
Writing (|l7|) explicitly: 

y(0) = 3X3(0) 
(18) y(l) = 9a; 2 (0)© 6x 3 (0) 

2/(2) = 14xi(0)©12x 2 (0)©9x 3 (0) 

and since the rows 4, 5, 6, ... of the observability matrix are proportional to 
the third row, it follows that two initial conditions cannot be distinguished by 
observation if and only if they lead to the same values for 2/(0), 2/(1) an d 2/(2) 
(note that the input sequence can only change the values of x 3 (fc) for k > 3). 
If we fix some values for X3(0), X3(l) and X3(2), then we can determine the set 
of the initial conditions (xi(0), X2(0), X3(0)) T which will lead to these values and 
therefore cannot be distinguished by observation. For example the set of initial 
conditions which lead to the values X3(0), 2:3(1) = 2:3(0) + 3 and 2:3(2) = x 3 (0) + 6 
is {(x 1 (0),x 2 (0),x 3 (0)) T : Xl (0) < x 3 (0) - 5,x 2 (0) < x 3 (0) - 3}, that is, the 
equivalence class for O u of the point (x 3 (0) — 5,x 3 (0) — 3, X3(0)) T (region (I)). 
Therefore, this equivalence class represents a set of initial conditions for which 
the starting time of machine 3 is critical, which means that the output times are 
determined by this starting time. Similarly, the light grey region (II) corresponds 
to a set of initial conditions such that #3(0) < 3 + x 2 (0) and x 2 (0) < 2 + xi(0). 
Every x(0) in the interior of this zone, whose equivalence class is a singleton, is such 
that the starting times of all machines are critical: the output time of the first part 
will only depend of the starting time of machine 3, the output time of the second 
part will only depend of the starting time of machine 2, and the output time of the 
third part will only depend of the starting time of machine 1 . The half lines (III) 
and (IV) have a similar interpretation, as summarized on Figure |^. 

4.4. Rational semimodules over M max need not be stable by direct image. 

When S = M max , the set of rational semimodules has no nice closure properties. 
We first show that the direct image of a rational set by a linear map need not be 
a rational set. Let a denote a positive irrational number, and consider the two 
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vectors 

' 1 
-a 



-a u = 



together with R = {u, v}* \ {0}. Since R = {u, v} + {u, v}*, R is rational. Now, let 
A = (0,0) G (Mmax) lx2 - We have that: 

A(R) = {max(/ii — a 1 /i2, h>2 — ahi) \ hi, hi G N, hi + hi > 1} 
(19) = {max(-a _1 t, t) | i = /i 2 - ahi, hi, hi G N, hi + hi > 1} . 

We claim that the set A(R) is not rational. Indeed, let us assume by contradiction 
that A(R) is scmilinear, i.e., that A(R) = Di<i<k{{cii} + U*), where the a% are 
elements of K U {— co} and the Ui are finite subsets of R U {— oo}. We first remark 
that since — oo ^ A(R), cti / — oo, and — oo Ui, for all 1 < i < k. Using this 
remark, we now deduce that the elements of Ui must be nonnegative: otherwise, 
A(R) would not be bounded from below, and this would contradict the fact that 
inf A(R) = which follows from ([l9|). Since all the elements of Ui are nonnega- 




tive, A(R) has a minimal element (namely mini<j<feai), and this contradicts (19) 
because a is an irrational number. 

We next show that when S — M max , the image of a rational semimodule by a 
linear map need not be a rational semimodule. Consider 



-a~ 1 u= | 1 


R={u lV y\{Q}, A = ( ° ° ~ a 

y — oo — oo 

and X = spani?. Then A(X) = span A(R) is spanned by the vectors 

fmax(hi — a~ 1 /i2, hi — ahi)\ r , , _ T , , . . 

I K )' x ' 2 G ' 1 2 - ' 

To make A(X) more explicit, let us observe that for all real numbers 7, S, 
(20) 

span ^ ^ = { (^j e M 2 I min(7, 5) + x 2 < Xi < x 2 + max( 7 , 5)} U { (Z^j }• 
It follows from (|o|) that 

(21) A(Af) = {^ GM 2 | *1>3 2 }U{(:~)} • 

Now, a straightforward variant of the proof of the irrationality of A(R) that we gave 
above shows that A(X) is not a rational semimodule, for, if A(X) was spanned by a 
scmilinear set, the quantity xi — x 2 would attain its infimum when x G A(X) OR 2 , 
whereas (|2l|) shows that this infimum, which is equal to 0, is not attained. 

Thus, when S — R m axi the direct image of a rational semimodule by a linear 
map need not be rational. 
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4.5. Noncommutative reachable spaces need not be rational. Let us con- 
sider now a time varying version of the max-plus linear system (^|), in which (12a) 
is replaced by 



(22) 



x(k) = A(k)x(k - 1) © Bu(k) 



where the matrix A(k) can take any value in a finite set {Ai, . . . , A r } C (Z max )™ xn . 

In order to characterize the reachable space and to show that it need not be 
rational, it is useful to introduce some classical automata theoretical notation 
(see [BR88Q. Let E = {a\, . . . ,a r } denote an alphabet of r letters. Recall that 
the free monoid E* is the set of finite words on E, equipped with concatenation 
product. Let /j, : E* — > (Z max )" x ™ denote the unique morphism of monoids which 
sends ai to Ai. The reachable space 72., that is, the set of all possible values of 
x(k) £ (Z max ) n , the control sequence u and the time k being chosen arbitrarily, 
starting from x(0) = e, is given by: 

TZ = span (a*(E*)-B) , 

where we represent by span (/i(E*)_B) the subscmimodulc which is generated by the 
columns of the matrices [i(w)B, for w £ E*. 

We next show that /u(E*), and a fortiori {fi(w)B | w £ E*}, need not be rational 
subsets of (Z max )" x ™ and (Z max )™ xp , respectively, and that the reachable space 1Z 
need not be rational, a result which illustrates a general difficulty of max-plus linear 
semigroups (in a further work [GK02|, we show that we cannot decide whether a 
matrix belongs to /u(S*), or whether a vector belongs to {/j(w)B | w £ E*}). In 
this paper, we will give a simple counter-example, which relies on a remarkable 
construction of I. Simon [3im90|. To minimize changes by comparison to |Sim9Cfl , 
we will work in the semiring Z m ; n , rather than in Z max . All the results that follow 
have of course equivalent versions in Z max . 

(Z m ; n ) 4x4 denote the unique morphism such that: 

/l 



Let v : {ai, 02} 
1/(01) = 



CO 
30 
X) 



X) 

1 

CO 
CO 



CO 

1 

CO 
CO 



CO 
CO 
CO 

0/ 



and 1/(02) 



co 
oc 
co 



and consider the function s : {ai, 02}* 
(23) s(w) = afi(w)(3 where a = (0 
bimon HSim9C|l shows that 



Z n 



OO CO CO 



V 

s(w), 
and j3 



1 

co 

CO 

oc 



'OC 

ct 

'OC 

oc 



CO 




0/ 



(0 



00 00 



or 



(24) 



i{\w\ j s(w) > n} = 



Vn £ N 



where \w\ denotes the length of the word w. In essence, (E4J) means that s(w) 

— > 00. We will use this property to build an 



takes values of order y/\w\ when 
irrational reachable space 1Z. 
Let 



D 



-1 
00 



■OC 1 





and consider the unique morphism (i : {ai, 02}* — > (Z m i n ) 



6x6 



(25) 



ju(oi) = diag(i/(ai), D), /u(a 2 ) = diag(i/(a 2 ), £>) 
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X 3 




Figure 6. An irrational subscmimodulc of (Z m i n ) 2 



where diag(F, G) denotes the matrix with diagonal blocks F and G and oo else- 
where. The following proposition shows that the reachable space 1Z obtained by 
taking 

i T 



(26) B = 

and /i as above, is irrational. 







o) j 



Proposition 4.4. Let fj, be defined by (25) and B by (|26j). Then, the reachable 
space 1Z = span (/i({oi, a,2}*)B) is an irrational subsemimodule o/(Z m i n ) 6 . More- 
over , the semigroup /ti({ai, ffla}*) is an irrational subset of ((Z U {+oo}) 6x6 , +). 



Proof. Let C denote the map (Z n 



C = 



(Z m ; n ) 3 . which is defined by the matrix: 




Then we get that 

(27) Cfi(w)B 



(s(w),-\w\,0)" J 



Vui e {ai, 02}" 



li X = span (/x({ai, 02}*)^) were rational, C(A') would also be rational, by The- 
orem |3.5| . We have represented C(X) on Figure |(| the irrationality of C{X) is 
intuitively clear from the figure, since the boundary of the semimodule has a dis- 
crete quadratic shape (extremal points are represented by bold points). 

However, proving that the figure is correct would require some reworking of the 
arguments of [3im9C], so we will give a simpler formal argument showing the ir- 
rationality of C(X). Since several words w of the same length can give the same 
s(w), the family {Cfi(w)B} we{aua . 2} , = {(s(w), -\w\, 0) T }we{ ai ,a 2 }* contains re- 
peated elements. So let us introduce a subfamily, {C fi(w) B} wG w , with the property 
that {Cfi(w)B I w G {01, a 2 }*} = {C^{w)B \ w G W}, and 



(28) 
Let 



w, z G W, \w\ = \z\ 



s(w) ^ s(z) 



W = {w e W I {zeW\{w} and s(z) > s{w)) 



\z\ > \ W \} 
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We claim that 

(29) Vw G W', Cfx(w)B is an extremal point of C{X). 

To show this, it suffices to check that there is no family {X z } Z £\v\w C Z m i n such 
that 

Cfi(w)B = A 2 ®C/i(z)B , 
zew\w 

i.e. 

(30) (a(w), -\w\,0) T = inf \ z + (s(z),~\z\,0) T . 

zew\w 



It follows from (|30j) that 

X z > max(s(w) — s(z), \z\ — \w\,0) . 

Now, by definition of W', max(s(w) — s(z), \z\ — \w\) > for all z G W such that 
z ^ w, and since X z > max(s(w) — s(z), \z\ — \w\) > is an integer, we conclude 
that A 2 > 1. Since this holds for all z G W \ w, the equality (|30| ) cannot hold, 
because the third coordinate of the right-hand side of (|3(]) must be greater than or 
equal to 1, whereas the third coordinate of the left hand side of (^) is equal to 0. 
This shows @. 

We finally show that G(X) is irrational. Consider 

(31) E = {(x u x 2 ) | {x 1 ,x 2 ,0) T e Ebct(C(*))} . 

If X were rational, so would be C(X), and by Theorem |3.7| , the set of extremal 
points Ext(C(X)) of C(X) would be rational, and so E would be rational. 

Now, it follows from the definition of extremal points that for any set G of 
generators of a semimodule X, 

(32) Ext(^) cZ + G= {A®j A e Z, g e G} . 



Combining (|3^), (|3l|), and (|29|), and using the fact that the third coordinate of 
C/j,(w)B is for all w £ {01,02}*, we get that 

(33) {(s(w),-\w\) I we W'} CE c{(s(w),-\w\) \ we{ai,« 2 }*} . 

Now, for any rational subset R of (Z 2 , +), consider the function: 

: 1 — > Z U {±00}, jR(n) = sup{fc G Z | (n, k) G R} , 

together with its support: 

supp7^ — {n G Z I 3k G Z, (n, fc) G -R} = {n G Z | 7fl(n) ^ — 00} . 

It follows from the fact that rational subsets of (Z 2 , +) are semilinear that if R is 
rational, the restriction of 7^ to its support can be bounded from below by an affinc 
function when n — > 00. But (|35| ) together with ( pi|) show that 7_b(w) = — (n 2 + n)/2. 
Therefore, -E is irrational, a contradiction. □ 



The counter example of Proposition 4.4 shows that the rational semimodulcs 



tools do not apply naturally to max-plus automata problems, such as the ones 
appearing in |Gau95| , |Kli99a| , |Kli99b[ . 
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